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TITLE OF THE INVENTION 
DIAGNOSIS SUPPORT APPARATUS AND IMAGE PROCESSING METHOD 

FIELD OF THE INVENTION 
5 The present Invention relates to a diagnosis 

support apparatus and an image processing method and, 
more particularly, to a diagnosis support method and 
apparatus which automatically extract an isolated 
shadow such as a tumor shadow from an image. 

10 

BACKGROUND OF THE INVENTION 

With recent advances in digital technology, a 
radiographic image is transformed into a digital image 
signal, which is displayed on a CRT or the like or 

15 printed out upon being subjected to image processing. 
In addition, recently, a diagnosis support apparatus 
which automatically extracts a tumor shadow or the like 
from a radiographic image has been developed. An image 
containing the tumor shadow or the like extracted by 

20 the diagnosis support apparatus is often displayed on a 
film or CRT. 

Such methods of automatically extracting isolated 
shadows include, for example, the isolated shadow 
extraction method disclosed in USP. 4,907,156. This 
25 method will be described briefly. A differential image 
between a tumor shadow enhanced image and a tumor 
shadow suppressed image is generated. Multiple 
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threshold processing is performed for the generated 
differential image, and known labeling processing is 
simultaneously performed, thereby calculating a feature 
amount such as a roundness from an isolated shadow 
5 having a value that is equal to or larger than a 
predetermined threshold and extracting an isolated 
shadow on the basis of the feature amount at the same 
time . 

As another method of automatically extracting 

10 isolated shadows, the following extraction method is 
disclosed in Japanese Patent No. 2,571,132. A 
component of a normalized gradient Vfij/ I Vfij I of 
image data fij of each pixel Pij (i = 1, 2,. ..,8; j = 
1, 2, 3) in the direction of a line segment Li is 

15 obtained by Vfij/ | Vfij | *ei (where ei represents a 
unit vector extending from each pixel Pij to a 
predetermined pixel P0, and * represents the inner 
product). (Note that the unit vectors ei are those 
extending from the pixel P0 in eight directions 

20 including horizontal directions, vertical directions, 
and 45° directions.) 

Then, assuming that the inward direction (the 
direction toward the predetermined pixel P0) of the 
component is positive, and the outward direction is 

2 5 negative, the maximum value of each line segment Li (i 
= 1, 2,..., 8) is obtained as follows: 

{Vfij/ | Vfij | *ei} M (i = 1, 2 8) 
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In addition, the sum of these maximum values {Vfij/ | 
Vfij I *ei} M is obtained. This sum is compared as a 
feature value C2 with a predetermined threshold Th2. 
Depending on whether C2 ^ Th2 or C2 < Th2 , it is 
5 determined whether or not the predetermined pixel PO is 
a pixel in each tumor shadow. 

In addition, a quoit -like morphological filter 
used to extract an isolated shadow is described in 
"Study on Automatic Lung Cancer Lesion Recognition 

10 Using 3D Morphological Filter" (Masato Nakayama et al. , 
Proceedings of Japanese Society of Medical Imaging 
Technology 95, pp. 60 - 67 (1995). This technique uses 
a Q filter expressed by a combination of a D filter 
(Disk Filter) having a radius r x and an R filter (Ring 

15 Filter) having inner radii r 2 and r 3 . This transform is 
called Q transform. More specifically, Q transform is 
the processing of subtracting the pixel value obtained 
after Dilation using the R filter from the pixel value 
obtained after Dilation using the D filter. The 

20 processing of performing Q transform of an image after 
Q transform will be referred to as inverse Q transform. 
The relationship between Q transform and inverse Q 
transform is similar to that between Fourier transform 
and inverse Fourier transform. This is because, Q 

25 transform can be regarded as a process of extracting a 
Q filter component in an image, and inverse Q transform 
can be regarded as a process of inversely transforming 
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the extracted component to express it in the original 
image space . 

The following is the definition expression of the 
Q filter. If the D filter (Disk Filter) D(x, y) and R 
5 filter (Ring Filter) R(x, y) are represented by 
D(x, y) = 0: for x 2 + y 2 ^ ri 2 

-°° : for others ...(1) 

R(x, y) = 0: for r 2 2 ^ x 2 + y 2 ^ r 3 2 
-°° : for others ...(2) 

10 then, Q transform is represented by 

G(x, y) = f(x, y)©D(x, y) - f(x, y)@R(x, y) 

...(3) 

where © represents Dilation. When an original image 
is represented by f(x, y) , and a filter function is 

15 given by h(x, y) , then 

f(x, y)®h(x, y) = max{f (x+xl, y+yl ) + h(xl, yl) 

I (xl, yl)^K} . . .(4) 

where K is the domain of the filter function. 

According to the inventions disclosed in 

20 USP 4,907,156 and Japanese Patent No. 2,571,132, 
isolated shadows can be enhanced. However, for 
example, in a chest image, images of regions other than 
an isolated shadow, e.g., edge portions such as a vomer 
shadow, are also enhanced. Consequently, not all 

25 regions with pixel values equal to or more than a 

predetermined value on an image after enhancement do 
indicate isolated shadow regions. In order to extract 
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only an isolated shadow, therefore, some kind of 
feature extraction processing must be done with respect 
to an enhanced image. 

In such processing, when a vomer shadow and tumor 
5 shadow are located near each other or they overlap, it 
is difficult to separate the tumor shadow from the 
vomer shadow, resulting in a deterioration in tumor 
extraction precision. In the invention disclosed in 
Japanese Patent No. 2,571,132, in particular, if the 

10 pixel value gradient of an entire region in which a 

tumor exists is stronger than that of a tumor shadow, a 
normalized vector representing the tumor shadow cannot 
be properly calculated, resulting in a deterioration in 
tumor shadow extraction precision. This raises a 

15 problem in extracting a tumor shadow existing near the 
periphery of the lung field from, for example, a chest 
frontal image . 

When a quoit -like morphological filter disclosed 
in "Study on Automatic Lung Cancer Lesion Recognition 

20 Using 3D Morphological Filter" is used, only an 

isolated shadow can be extracted. Therefore, feature 
amount extraction processing and the like need not be 
performed for isolated shadow extraction. In addition, 
even if a vomer shadow and tumor shadow overlap, only 

25 the tumor shadow can be extracted. 

In practice, however, tumor shadows rarely exist 
in a bulging state, and tumor portions generally blend 
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as images with surrounding images like stains . For 
this reason, a quoit-like morphological filter is not 
suited for the extraction of an actual tumor shadow 
existing in, for example, a chest image. This is 
5 because a quoit -like morphological filter works well 
only when a tumor shadow bulges from surrounding 
images . This raises a problem in extracting a tumor 
shadow existing near the periphery of the lung field 
in, for example, a chest frontal image. 

10 

SUMMARY OF THE INVENTION 
The present invention has been made to solve the 
above problems, and has as its object to properly 
extract an isolated shadow such as a tumor shadow. 

15 It is another object of the present invention to 

develop a diagnosis support apparatus which can extract 
an isolated shadow such as tumor shadow even if it 
overlaps a vomer shadow or is located at the periphery 
of the lung field. 

20 In order to solve the above objects, a diagnosis 

support apparatus according to the present invention 
has the following arrangement. That is, there is 
provided a diagnosis support apparatus which supports 
diagnosis by processing an image, comprising: an 

25 enhancement unit configured to enhance a circular 

shadow existing in an image by enhancing a pixel value 
gradient of the circular shadow; and an extraction unit 
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configured to extract an isolated shadow from the image 
enhanced by the enhancement unit . 

In addition , in order to solve the above 
problems, a diagnosis support method according to the 
5 present invention processes an image for diagnosis 
support, and comprises: an enhancement step of 
enhancing a circular shadow existing in an image by 
enhancing a pixel value gradient of the circular 
shadow; and an extraction step of extracting an 

10 isolated shadow from the image enhanced in the 
enhancement step. 

Other features and advantages of the present 
invention will be apparent from the following 
description taken in conjunction with the accompanying 

15 drawings, in which like reference characters designate 
the same or similar parts throughout the figures 
thereof . 



BRIEF DESCRIPTION OF THE DRAWINGS 
20 The accompanying drawings, which are incorporated 

in and constitute a part of the specification, 
illustrate embodiments of the invention and, together 
with the description, serve to explain the principles 
of the invention. 
25 Fig. 1 is a block diagram showing the arrangement 

of X-ray imaging device according to the first 
embodiment ; 
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Fig. 2 is a flow chart showing the flow of 
processing in a diagnosis support circuit 112 in the 
X-ray imaging device according to the first embodiment; 

Fig. 3 is a flow chart showing the flow of 
5 processing in an enhancement processing circuit 113 in 
the X-ray imaging device according to the first 
embodiment ; 

Fig. 4 is a flow chart showing the flow of 
processing in an extraction circuit 114 in the X-ray 
10 imaging device according to the first embodiment; 

Fig. 5 is a block diagram showing the arrangement 
of X-ray imaging device according to the second 
embodiment ; and 

Fig. 6 is a flow chart showing the flow of 
15 processing in a diagnosis support circuit 112 in the 
X-ray imaging device according to the second 
embodiment . 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
20 Preferred embodiments of the present invention 

will now be described in detail in accordance with the 
accompanying drawings. 
< First Embodiment > 

Fig. 1 is a block diagram showing the arrangement 
25 of X-ray imaging device 100 according to the first 
embodiment. As shown in Fig. 1, the X-ray imaging 
device 100 has a diagnosis support function, and 



- 8 - 



CFM03556 / P204-0154 

includes a preprocessing circuit 106, CPU 108, main 
memory 109, operation panel 110, image display device 
111, and diagnosis support circuit 112. These 
components exchange data through a CPU bus 107. 
5 In the diagnosis support circuit 112, an 

enhancement processing circuit 113 enhances a circular 
shadow such as a tumor shadow contained in an image to 
form a bulging shadow. An extraction circuit 114 
extracts a bulging shadow from the image in which the 

10 circular shadow is enhanced by the enhancement 

processing circuit 113. A labeling circuit 115 labels 
the extracted region by performing known labeling 
processing with respect to the image processed by the 
extraction circuit 114. 

15 The X-ray imaging device 100 also includes a data 

acquisition circuit 105 connected to the preprocessing 
circuit 106, and a two-dimensional X-ray sensor 104 and 
X-ray generating circuit 101 which are connected to the 
data acquisition circuit 105. These circuits are also 

20 connected to the CPU bus 107. 

In the above X-ray imaging device 100, the main 
memory 109 stores various data required for processing 
in the CPU 108 and the like, and includes a work memory 
for operation by the CPU 108. For example, the CPU 108 

25 controls the operation of the overall apparatus by 
using the main memory 109 in accordance with the 
operation instructions input from the operation panel 
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110. With this control, the X-ray imaging device 100 
operates as follows. 

First of all, the X-ray generating circuit 101 
emits an X-ray beam 102 to a subject 103 to be 
5 examined. The X-ray beam 102 emitted from the X-ray 
generating circuit 101 is transmitted through the 
subject 103 while being attenuated, reaches the 
two-dimensional X-ray sensor 104, and is output as an 
X-ray image from the two-dimensional X-ray sensor 104. 
10 Assume that in this case, the X-ray image output from 

the two-dimensional X-ray sensor 104 is a chest frontal 
image . 

The data acquisition circuit 105 converts the 
X-ray image output from the two-dimensional X-ray 

15 sensor 104 into an electrical signal and supplies it to 
the preprocessing circuit 106. The preprocessing 
circuit 106 performs preprocessing such as offset 
correction processing or gain correction processing 
with respect to the signal (X-ray image signal) from 

20 the data acquisition circuit 105. The X-ray image 
signal having undergone the preprocessing in the 
preprocessing circuit 106 is transferred as an original 
image to the main memory 109 and diagnosis support 
circuit 112 through the CPU bus 107 under the control 

25 of the CPU 108. 

Fig. 2 is a flow chart showing the flow of 
processing in the diagnosis support circuit 112 
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according to the first embodiment- Figs. 3 and 4 are 
flow charts showing the flows of processing in the 
enhancement processing circuit 113 and extraction 
circuit 114, respectively. The processing performed by 
5 the diagnosis support circuit 112 will be described 
below with reference to these flow charts. 

First of all, the enhancement processing circuit 
113 causes a circular shadow to bulge from a 
surrounding image region by enhancing the circular 

10 shadow, and performs the processing of suppressing the 
overall pixel value gradient of an original image (step 
S201). This processing is important in improving the 
isolated shadow extraction precision in step S202. In 
this case, "the processing of suppressing the overall 

15 pixel value gradient" is equivalent to suppressing the 
overall pixel value gradient of the image as a result 
of enhancement processing. For this reason, the 
gradient of the periphery of the lung field is also 
suppressed. However, the gradient of the periphery of 

20 the lung field is not suppressed in a form suitable for 
the extraction of a tumor shadow. 

Any kind of enhancement processing can be used as 
long as it enhances a circular shadow. In this 
embodiment, the following processing is performed. Let 

25 f(x, y) be a pixel value at coordinates (x, y) on an 

original image. A normalized gradient "Vfij/ | Vfij | " 
(basic vector) of each pixel f(i, j) having vector 
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component x(i, j) = f(i+d # j) - f(i, 3) in the x 
direction and vector component y(i, j) = f(i, 
j+d) - f(i, j) in the y direction is calculated 
throughout the original image (step S301 in Fig. 3). 
5 Letting Vfij/ I Vfij | be the normalized gradient of 

image data fij of each pixel f(i, j) on a circle having 
radius r and a center point with the coordinates (x, y) 
on the original image, and letting e(i, j) be a unit 
vector extending from the coordinates (x, y) to a point 

10 f(i, j) on the circle, Vfij/ | Vfij | *e(i, j) (where * 
represents the inner product) is obtained (step S302). 

Then, assuming that the inward direction of the 
component is positive, and the outward direction is 
negative, the sum of {Vfij/ | Vfij I *ei} is obtained 

15 (step S302) . 

This sum is set as a pixel value at coordinates 
(x, y) after enhancement processing. In general, a 
tumor shadow is a circular shadow, and is obtained as 
image data in the form in which the peripheral portion 

20 of the circular shadow permeates in a surrounding 

image. Therefore, the inner product of a pixel value 
gradient on a circle adjusted to the radius of the 
circular shadow and a unit vector extending from the 
center point of the circle to a point on the circle 

25 becomes a large value when the center point of the 

circle almost overlaps the center point of the tumor 
shadow. As a consequence, the image after the 
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processing becomes an image with a bulge centered on 
the center point of the circular shadow (a circular 
shadow with a large pixel value gradient centered on 
the center point of the circular shadow) . 
5 The extraction circuit 114 extracts an isolated 

shadow from the image enhanced by the enhancement 
processing circuit 113 (step S202). 

The following is an example of a specific 
sequence for extraction processing. The following 
10 sequence is based on the technique disclosed in "Study 
on Automatic Lung Cancer Lesion Recognition Using 3D 
Morphological Filter", and extraction processing using 
a morphological filter. 

First of all, the D filter (Disk Filter) D(x, y) 
15 and R filter (Ring Filter) R(x, y) are defined as 
follows : 

D(x, y) = 0: for x 2 + y 2 ^ r x 2 

-°° : for others ...(1) 

R(x, y) = 0: for r 2 2 ^ x 2 + y 2 < r 3 2 
20 -oo : for others .-.(2) 

A maximum value Gl(x, y) within a radius ri 
centered on the coordinates (x, y) on the original 
image is calculated (step S401) according to: 

Gl(x, y) = f(x, y)0D(x, y) ...(3) 
25 A maximum value G2(x, y) within a ring with radii 

r 2 and r 3 centered on the coordinates (x, y) on the 
original image is calculated (step S402) according to: 
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G2(x, y) = f(x, y)0R(x, y) -..(4) 
In this case, the radii r i# r 2 , and r 3 may be 

determined on the basis of experiments. If, for 

example, a tumor shadow to be obtained has a size of 15 
5 mm, it suffices, according to experiments, if ri = r 2 = 

about 8 mm, and r 3 = about 9 mm. 

The difference between maximum values (the 

difference between Gl and G2) is calculated (step S403) 

according to: 

10 G3(x, y) - Gl(x, y) - G2(x, y) ...(5) 

If 0 represents Dilation and the original image 
and filter function are represented by f(x, y) and h(x, 
y) , respectively, in equations (3) and (4), then 

f(x, y)0h(x, y) = max{f(x+xl, y+yl) + h(xl, yl) 

15 I (xl, yl) <=K} ... (6) 

where K is the domain of the filter function. In this 
case, D(x, y) and R(x, y) correspond to the domains K 
in equations (3) and (4), respectively. 

In the image G3(x, y) obtained in the above 

20 manner, an isolated shadow in the enhanced image is the 
extracted image. That is, a range of a predetermined 
pixel value or more of G3(x, y) is an image region 
existing in the isolated shadow. An isolated shadow 
region can therefore be labeled by assigning 1 to a 

25 pixel value in an image region within a predetermined 
pixel value range and assigning 0 to a pixel value in 
other ranges, and performing general labeling 
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processing with, respect to the region of image having 
pixel value 1 (step S203). That is, the region labeled 
in step S203 is an isolated shadow region, and is 
highly likely to be a tumor shadow. 
5 As described above, by using the isolated shadow 

extraction method according to the first embodiment, a 
shadow permeating in a surrounding image like an actual 
tumor shadow can be extracted more reliably. In 
addition, an image region of a processed image which 

10 exhibits a value equal to or more than a predetermined 
threshold always falls within an isolated shadow. 
Furthermore, labeling processing makes it possible to 
accurately calculate the region even if a plurality of 
isolated shadow regions exist. 

15 < Second Embodiment > 

In the second embodiment, a high-frequency image 
is obtained from an original image, and the obtained 
high-frequency image is processed in the same manner as 
in the first embodiment. 

20 Fig. 5 is a block diagram showing the arrangement 

of X-ray imaging device. As shown in Fig. 5, a 
high-frequency component generating circuit 201 is 
added to the arrangement of the X-ray imaging device 
according to the first embodiment (Fig. 1). The 

25 high-frequency component generating circuit 201 

generates a high-frequency component of an original 
image. The operation of the X-ray imaging device 
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15 



20 



according to the second embodiment will be described 
below with reference to the flow chart of Fig. 6. 

Fig. 6 is a flow chart showing the flow of 
isolated shadow extraction processing according to the 
second embodiment. Referring to Fig. 6, the same step 
numbers as in the first embodiment (Fig. 2) denote the 
same processing, and a description thereof will be 
omitted. 

The high-frequency component generating circuit 
201 generates a high-frequency component image Sus(x, 
y) (step S601) according to: 



Then, the same processing as the above described 
first embodiment is applied to the image Sus(x,y) . 

According to the first embodiment, when the 
gradient of a background image is large as in the case 
of the periphery of the lung field of a chest frontal 
image, a normalized gradient may not be accurately 
obtained. This is because when the gradient of a 
background is large, the gradient of the background 
image influences the direction of a normalized 
gradient. In contrast to this, according to the second 
embodiment, since enhancement processing is performed 
with respect to a high-frequency component image, a 
normalized gradient can be accurately obtained from 
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such a region. This allows extraction of a tumor with 
high precision. This applies to enhancement processing 
using other methods. The use of a high-frequency 
component improves the tumor shadow extraction 
5 precision. 

As has been described above, according to the 
present invention, an isolated shadow such as a tumor 
shadow can be properly extracted. 

In addition, according to the present invention, 

10 even if an isolated shadow such as a tumor shadow 

overlaps a vomer shadow or is located at the periphery 
of the lung field, an isolated shadow can be reliably 
extracted. 

Note that the present invention can be 

15 implemented by supplying a software program, which 

implements the functions of the foregoing embodiments, 
directly or indirectly to a system or apparatus, 
reading the supplied program code with a computer of 
the system or apparatus, and then executing the program 

20 code. In this case, so long as the system or apparatus 
has the functions of the program, the mode of 
implementation need not rely upon a program. 

Accordingly, since the functions of the present 
invention are implemented by computer, the program code 

25 installed in the computer also implements the present 
invention. In other words, the claims of the present 
invention also cover a computer program for the purpose 
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of implementing the functions of the present invention. 

In this case, so long as the system or apparatus 
has the functions of the program, the program may be 
executed in any form, such as an object code, a program 
5 executed by an interpreter, or scrip data supplied to 
an operating system. 

Example of storage media that can be used for 
supplying the program are a floppy disk, a hard disk, 
an optical disk, a magneto-optical disk, a CD-ROM, a 

10 CD-R, a CD-RW, a magnetic tape, a non- volatile type 
memory card, a ROM, and a DVD (DVD-ROM and a DVD-R) . 

As for the method of supplying the program, a 
client computer can be connected to a website on the 
Internet using a browser of the client computer, and 

15 the computer program of the present invention or an 
automatically- installable compressed file of the 
program can be downloaded to a recording medium such as 
a hard disk. Further, the program of the present 
invention can be supplied by dividing the program code 

20 constituting the program into a plurality of files and 
downloading the files from different websites. In 
other words, a WWW (World Wide Web) server that 
downloads, to multiple users, the program files that 
implement the functions of the present invention by 

25 computer is also covered by the claims of the present 
invention . 

It is also possible to encrypt and store the 
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program of the present invention on a storage medium 
such as a CD-ROM, distribute the storage medium to 
users, allow users who meet certain requirements to 
download decryption key information from a website via 
5 the Internet , and allow these users to decrypt the 

encrypted program by using the key information, whereby 
the program is installed in the user computer. 

Besides the cases where the aforementioned 
functions according to the embodiments are implemented 

10 by executing the read program by computer, an operating 
system or the like running on the computer may perform 
all or a part of the actual processing so that the 
functions of the foregoing embodiments can be 
implemented by this processing. 

15 Furthermore, after the program read from the 

storage medium is written to a function expansion board 
inserted into the computer or to a memory provided in a 
function expansion unit connected to the computer, a 
CPU or the like mounted on the function expansion board 

20 or function expansion unit performs all or a part of 
the actual processing so that the functions of the 
foregoing embodiments can be implemented by this 
processing. 

As many apparently widely different embodiments 
25 of the present invention can be made without departing 
from the spirit and scope thereof, it is to be 
understood that the invention is not limited to the 
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specific embodiments thereof except as defined in the 
appended claims . 
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